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PIIEFACE 



Miat educational puiposes shQuld the school seek to attain? This 
question, reqiiiring veiy serious value judgeinents, is at the heart 
of decision- inaking in education, according to the moi.t widely 
accepted rationale fo^ curriculim building. It is generally agreed 
that three major sources must be consulted in attempting to answer 
it appropriately: The society , the learner, ajid the subject matter. 
Any effort to substantively in^Drove the quality of educational pro- 
granis for Merican Indians p in addressing itself to those judgnientSi 
must necessarily become involved with aspects of language and culture 
as they are either included in the educational prograjn^ or as they 
materially effect what is selected or rejected as part of a curricu- 
lirni. The -'Society-* must be considered as that cOTblnation of social, 
economic, and cultural ciromistances fTom which the given school 
population derives, not those in some view of the '^Average American 
Town**, Hie ^learner" as a data source for cun^iculLDn building in 
Indian education likewise must be *'this particular learner**, an Indian 
child bom and reared in a imique socio- cultural -linguistic setting, 
and these learners and societies must be consulted first when seeking 
to make educational decisions. Only then will it be worttoshile to 
discuss prograjn content in tenns of subject matter. 

Ideologically, md theoretically, these principles are easy to accept, 
but methodologically, they are most difficult to accanplish* American 
Indians' present day life styles and socio-cultural'linguistlc circun- 



stances are extremely varied, Tliey include remote, isolated > non- 
English speaking peoples: rural, farming -rmiching, English speaking 
and non-English speaking populations; urban and suburban skilled^ 
senii-skilled, and professioiial people; and many more, How can we 
build better progranis to meet such wide-ranging educational needs? 

The avowed national policy in all matters involving the lives and 
welfare of American Indians^ including the education of their chil- 
dren, has been dosignated as one of serious promotion of self deter- 
mination* If vigorously pursued^ this policy would reverse long- 
held notions about the ends to be sought by and for the individual 
urithin his oto sub-culture or within the larger society. Value judg- 
ments must be systematically ascertainedj and goals and objectives 
deriving from them must be the focus of rigorous mi conscientious 
examination. 

But how shall we approach a task which is oveTOhelming in its conpl©c- 
ity even to conteinplate? How can we effectively consult these diverse 
societies and learners to arrive at better answers to the all iripor- 
tant questioUj 'IVhat educational puiposes should the school seek to 
attain?-' 

The task to be Lmdertaken is that of ascertaining educational needs ^ 
and needs assessment is a canponent of the process of evaluation* 
In 1972 the Division of Evaluation of the Office of Education Programs ^ 
Bureau of Indian Affairs, developed a design for the Bureau-wide accom" 
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plisJuTient of educational needs assessment, ^d a nunber of ijuportant 
steps were taken toward iirqpleiiientation of that design. 

The following report presents that desi^. It also Includes rationale 
for increasiiig the effectiveness of Bureau-wide educaticnal decision- 
making through increased evaluation con^etencies and appropriate use 
of infonnation. 
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BIA EDUCATIONAL mm ASSESSMS^ 



INTTODUCTION 

The Buroa'j of Indian Affairs has had the responsibility for provid- 
ing education programs for Americaii Indians , Alouts, ^d Eskimos for 
over 100 vears. The Offico of Education Programs within the BuTGau 
has responded to changing political clinmtOj varying sociological- 
anthropologica] thcoiy, and cyclOH of societal interest with efforts 
to assess and meet the Dducational needs of Native Americans. Many 
of those efforts J recorded in considerable detail in Governmental 
Archives, would be considered objective studies and of high quality 
even by today's criteria ^ yet they would not be useful for tO(^y*s 
program planning needs. Several elements have not heretofore been of 
concern in the determination of needs and the systematic planning of 
prograiTB to meet those needs: 

(a) The specificity of language used today in development of 
defensible educational goals and objectives has only recent- 
ly come into general use in American education and in Bureau 
education programs* 

(b) The population to be served was often viewed as homogeneous 
and quite monolithic, whereas it is really extremely varied 
socio-culturally^ linguistically, geographically, and econo- 
mically* Any model for adequately assessing educational 
needs among Native j^ericwis must be able to accomo^te those 
diversities. 
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(c) The present Federal Administration has proclaimed a policy 
o£ promoting self-determination on the part of Native 
Americans wherever they niay live within the United States. 
VVhereas others Cnon-Native Americans) have historically 
decided matters of educational policy and programs for them, 
the current focus will require that Native Americans them- 
selves be central to the decision-making. 

(d) There are many avenues through which educational services 
are provided to Native Anericans. Special programs repre- 
sent historical efforts to respond effectivel/ to special 
educational needs, among which are the Johnson O'Nklley pro- 
gram, reservation boarding schools, and the off -reservation 
boarding schools. In addition to the diversity of population 
to be served, we have diversity among existing programs pro- 
vided for that population. In view of this diversity, the 
task then, of ascertaining the educational needs of American 
Indians and other Native toerlcans is extremely complex. 
Needs assessment strategies must accomodate that complexity. 

The responsibility for designing and in^lementing a Bureau-wide needs 
assessment rests with the Division of Evaluation and Program Review of 
the Office of Education Programs. This is considered to be a task of 
the highest priority for Indian Education. 
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DEFIN ITIONS 

(a) "Educational needs assessinent is a technique for identifying 
those educational objectives which most need to be acconrqp- 
lished in a given instructional situation." 

(b) '^Needs assessment involves stating potential educational goals 
or objectives Cpi^eferably in tenns of student perfoiiimnce 
rather than instructional processes), deciding which of these 
are of highest priority^ and determining how well the existing 
educational prograjn is meeting these objectives*^ (The Center' 
Changing Evaluation Model, Center for the Study of Evaluation, 
Klein, et.al) 1971, 

(c) -'TTie first role of educational evaluation occurs with respect 
to what is increasingly referred to these days as needs assess - 
ment . In the needs assessment operation^ an educator attenpts 
to identify the goals toward which an educational system ought 
to be directed. Another way of putting it is that the educator 
is deciding on the objectives for the educational system, , . , 
decisions regarding what educational objectives ought to be pur 
sued can emerge as a consequence of comparing current learner 
performamce data with preferences regarding what that perfor- 
mance should be." 

Definitions (b) and (c) make specific reference to the role of the needs 
assessment in selecting the goals of preference for an educational sys- 
tem, then proceeding to ascertain the degree to which existing programs 



are producing the deaired studeiit behavior as outccines. Definition 
(a) assunes the prior existence (detenninatioii) of systeni goals ajid 
instructional objectives, and calls for an assessmmt of a^.tual leanier 
performance in coniparison with the preferred or desired perforiiiaiicei 

The Bureau of Indian Affairs^ effort in the conduct of m educational 
needs assessment is at the ''Goal Selection^' stage^ and efforts duTA^iis 
FY 1972 and W 1972 may be said to corxespond to the first five steps 
of the Needs Assessment Modg^l developed hy Kleins et.al,^ at the Center 
for the Study of Evaluation. (See Jigure I)* 
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It is pl^ed that in 73, the continuatioii of Project ORBS will 
ccnstltute the central effort to: 

(a) develop and refine the model for detetTninlii^ Goals*' mt the 

reiminlng ORBS Secondary Schools * 
Cb) Train staff frm BIA Area Office^ md schoaHs to assist In 
in^lemeritstlon of the model at thos^ pRBS schools. 

(c) Adapt the model to the elanentaiy" Lw^l* 

(d) Produce goal data for all ORBS, 

(e) Fom the basis on ivhich goal- select ior% will be able to p:ro- 
ceed at all Bureau schools (2O0)* 

Part Two of Phase toe of the needs assessn»iit will befiia iiririg 73 
at Chilocco md Shennan Indian High Schools v^er€ goal select doia instTU- 
mentatioii ras developed duruig the past artiool yeELT, This vill involve 
Area^ Agencyi ajid school le\rel personJieL) ifnder coordinatiOT and traiii- 
ing of the Dlvisioii of Evaluation in: 

(a) Selection and/or development of s'ubgoals based on goals detar- 
inined In Part Onm of Phase Che. 

(b) Pr^aratlon of objectives reflecting tie si^goal^. 

(c) Preparation of instructional Level beh^vtorgtl Qbj ectiv^s aiid 
accon^anylng criterion ItemLS, 

^e Division of Bvalmtlon of tl i BIA has utilized several training pw- 
graiM during FV 72 in pTeparlng Area fersoitfiel aiid others C^'g^i schocl 
board menibers) to assist In develDjmeJit cf dnstruiMits far determination 
of goals, itoong those are pxogrms developed by TOCET ^sceiat«s mder 
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pTofessoT W. Popham o£ UCLA* These progrms will continue to provide 
iniportarit asslstmce during Phase One of the Needs AjsesMent Program* 

The Division will also recormnend that si±goals may be generated most 
efficiently by utilizing already prepared hierarchies of goals and 
objectives such as that developed by the Center for the Study of Eval- 
uation at UCLA., The magnitude of the tasks involved in a Bureau-wide 
needs assessment requires that vdierever possible ^ existing data ba^s 
he utilized rather than attCTpting to re- invent the ivhael. In this 
regard, it will also be reconmended that existing collections of meas = 
urable objectives be used as data basis for salecting specific program 
objectives* One such collection is that prepared by the Instructional 
Objectives techange (lOX) of Los Angeles, which is avaLilable to BIA 
eijcators fron our library* 

The TOrk will be perfomed imder the direction of the profess ioiml staff 
of the Division of Evaluation md Program Review md may^ froni tine to 
tmej involve the services of emluation consultants frMi imiversities 
and colleges p regional laboratories, state departments of education, 
and private consultant fi^M, 
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I. FISCAL YMR 1972 

Planning for the developnent of educational needs assessment ty the 
Office of Education Programs of the Biireau of Indian Affairs tegaii in 
the Spring of 1971. The Director of Iducatlon Programs announced to 
his staff at that tune that lie ms placing top priority on syst«imtic 
planning Mid evaluation of Federal programs of the BIA, As a result 
of this decision several activities were planned and implemented during 
K 1972 as part of an overall effort to more ^equately assess tiie edu- 
cational needs of Indian learners. The pilot effort was directed toviard 
the of f= reservation boarding schools operated by the BIA , This activity 
came to be referred to as Project ORIS aid focused initially on the sec- 
ondary level boarding schools. iTiis project will constitute nwst of 
Phase One of the projected needs assessment. 

Authorization ms also given to proceed with planning of a needs 
assessnient at the elemental level for Bureau boarding schools , but 
time and staffing constraints have not peimitted the undertaMng as yet. 

Another major effort during FY 1972 which is related to the conduct of 
educational needs assesanent in the BIA is involved with the qiiestion 
,of testing. It ms felt that, while testing is an evaluative process, 
and should yield ijnportant data relative to assessing educatlorml needs , 
the procedures and policies relative to testing of Indian students had, 
over time, beccme so conftised in puipose as to be virtually useless for 
educational planning. At the same time, a lack of wqplicit behavioral 
goals for instruction left no defensille basis on i^ich to select and 
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administer tests, or direct effective use of data. As a result, a 
task force on testing CTFT) vms established for the puipose of deter- 
mining defensible testing policies. TTie caiprehfnslve policy on 
testing developed by the TFT reinforces the approach to needs assess- 
ment outlined in this paper. Student, parent and commLniity arf to ho 
involved and consulted, and criterion referenced testing with inmedi- 
ate feedback (as ^posed to noim- reference, standardized testing) are 
to be basic priiiciples of the poliQr. iTie policies will be published 
and released shortly. 

As currently conceived by the Education Omce of the Bureau of Indian 
Affairs, needs assessment Is a function of evaluation. Evaluation 
totally, is viehred as the process of ascertaining the decision areas of 
concern, selecting appropriate infomation, collecting and aaalyaiiig 
infomatlon in order to report sunniary data useful to decisloii-iiiakers 
in selecting among altematlves . (Alkin, 1970) . 

Thb needs assesanent is viewed as one of several basic features or 
phases of evaliiation, and is concerned vim the first aspect of the 
definition stated above: that Is, ascertaining the decision areas of 
concern. This is accon^llshed principally by obtaining statonejits of 
potential educational goals or objectives, detennining which of these 
are of highest priority, then judging the extent to vhich the list- 
ing educational progrem is meeting these objectives. The discrepant 
between Intended Cdesired, hoped for) outcomes and actual perfoimance 
outcomes r^resents the area of needs. This abroach to educational 
needs assessment in the BIA is illustrated in Figure 2. 
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As previously stated, anphasis dicing FV 1972 in mdertaking the devel- 
opment of an eiicational needs assessment within the BIA has been at the 
secondaT)^ level, and has involved two off-reseTvatlon boarding schools - 
Shennan, Riverside, Callfomia and Chilocco at Oillocco, Oklahoma. 

The BIA operates some 23 such sdiools, defined as schools located beyond 
the bomdaries of established Indian Reservations, and which provide edu- 
cational programs and boarding facilities for Indian students at either 
the secondary or the eianentary level. 

In deciding to first imdortake the needs assessment of ORBS Hi^ Schools, 
it was agreed that planning for needs assessment at the elanentary level 
would occur during djnplementstion of the secondaiy model. This will 
still be part of Hiase One- -Determine tlon of toals. That is,, following 
the 1971-72 developnent o£ imtrLmentation at the two high schools, the 
resulting model will be utilized in the ranainiiig ORBS High Schools 
during the 72-73 school year, and adaptation to elaaentaiy level will 
ot:cur concurrently. The aj^roach relative to unplenientation of needs 
assessment, is shovm in Figure 3, 
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n. ACCffl^LISHMENTS 

Needs assessment Is central to what the BIA has tenned the off- 
resewatlon boarding school project (ORBS), nie priiiclple objec- 
tive of this project Is to develop long-range educational goals 
and objectives stated in teims o£ what the Indian people vant and/or 
ej^ect . 



Diorlng the summer and fall of 1971, a Request for Proposals wa 
prepared by the Office of Bducatlon Programs and sent to a,nLanber 
of all- Indian education organizations. 

The contract was ultimately awarded to the National Indian Training 
and Research Center CNmiC) of Tanpe, Arizonaj an all- Indian, non- 
profit organization. Part of the instrunentation for ORBS is being 
aeveloped by NITRIC. TTie NrTOIC part of the instrumentation develop- 
ment was conducted at ShenTian Indian High School, Riverside, California, 
and the first oral report by tlie contractor was presented to Central 
Office and school personnel on ITiursday, June IS. 

TTie second major effort during 1972 in the developnent of instruc- 
mentatlon for ORBS was developed at Chilocco Indian School, during 
the period Februair 16 - April 7, 1972. This project was called the 
Chilocco Survey and its principle objective was also to produce a set 
of long-range goals for Chilocco Indian School. 

The approach to the Chilocco Survey was to involve local people on a 
survey team in order to make the undertaking a cooperative one. A 
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proposal to that effect was drawn up and presented to the Chilocco 
School Board. The Board approved the proposal and the survey was 
imdertaj^en. 

The first task of the survrey team In the effort to detennine priori- 
ties in long-range goals was the developnent of a questionnaire. Hie 
questionnaire represents one teclmique for obtaining the views of a 
sampling of Indians on educational goals. This is the first time in 
the histoiy of the BIA that this approach to program development has 
been anployed, and parents, students and staff opinions were sought 
and obtained. 

A planning conference was held in Albuquerque during the week of Jiaie 
S-9 relative to Project ORBS. People from both the Sheiman and Oiilocco 
School activities were involved in assessing the progress of their 
separate efforts toward acconplishing goals selection. Instrunentation 
from both projects was reviewed, and recmmendations developed for next 
steps to be taken in preparation for the coming school year 1972-73, 
during which goals selection will be conducted at the ranaining off- 
reservation boarding schools. 

The planning conference had the following objectives: 
CD Refine and adopt instrumentation relative to ORBS. 
(2) Develop procedures for implCTienting ORBS at each participating 
school . 

C3) Develop an inservice training workshop for ORBS personnel who 
will assime major responsibility for conducting the project at 
each school. 
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The Inservice training refers to an intensive workshop to be conducted 
by the Division of Evaluation and Program Review in late July, 1972. 

This will be explained under Section III. The workshop represents 
the first major component of the Bureau-wide goals selection activity 
scheduled for FY 1973. TTiis activity is shoim in Figure 3 and carries 
the caption, "Train Secondaiy Staff for Inplementation". 

The continuation time- frame for Phase One during FV 73 is shown in 
Figure 3, as well as the longer range projection into Phase Two assess- 
ing perfonnance on subgoals and objectives. It should be noted that 
the projection includes the adaptation md development of a goals selec- 
tion model for the elementary level, ITie needs assessment cycle is 
represented in the model in Figure 4. 

In simmary, the BIA is in the process of going to Indian people and 
asking them to detennine goals which will guide the education of their 
children. These goals will be the basis from which Bureau educators 
will develop specific educational objectives (see Figure 3). A behav- 
ioral comparison of actual learner perfomance with desired learner 
behavioral outcomes as represented by these goals and objectives will 
constitute the Bureau-wide needs assessment strategy. 



The needs assessment model (Figure 4) represents the approach to b 
followed in the assessment of BIA Education. ITie following dis 
will describe each step in the model in more detail . 
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(1) Determination of Goals hy IndiMi People 

This is tiie foundation of the total systan. Goals must 
represent the desires o£ Indiaii peoples j ajid progress 
toward a^leving the goals is to be r^orted back to them, 
This requires that BIA ©ducators develop new methods and 
e^and existing methods of eommmicating with Indian com- 
munities. Hie model raquires that Indian pe^le know what 
they want of the school and that the school In return keep 
them infomed regarding how well Indian children are doing 
in achieving the goals* It shoiad be noted that , where 
feasible^ probably in all high schools, the students are 
to be broi^ht in on the process , The model also calls for 
the educator to be a true professional. His job is to 
desipi ^d in^l«nent programs ttet will achieve the goals 
selected or determined by Indiai peoples , 
(2) Selection of Goals 

TTiis professional task calls for developinent of a range of 
possible goals and tiying than out on Indian people in an 
openended maimer. That is, nmny goals will be presented to 
people f rm which they may select preferences . They will 
be invited to suggest items not included in the inquliy. 
Ultimatelyi a data bank of goals will be assOTibled and used 
as a basis for needs assessment at evmrf level of operation. 
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(3) The ilow of program direction and control will start with 
Indian pecple, who, through various techniques of ccmntmi- 
cation, mil tell professional educators what the long- 
range goals of the program should be. TTiose goals that 
are considered most Important, according to an Indian con- 
stituten^, will be used as bases for develoOTient of siA- 
goals. Tliis will be accmpllshed through the use of pre- 
pared hierarchies, wherever possible, by the professional 
school staff. 
(4) School Selects Appropriate Objectives 

It is the task of the professional educator at the school 
level to take the Indian- determined goals and the subgoals 
and tr«islate thm to more specific instructional objectives. 
Instructional objectives at the local level must relate to 
the general, global goals which have been detemdned by 
Indian people. Objectives banks as data sources will be 
reconmended for acconplisjment of this task. Criterion 
items included with the objectives will fom the basis for 
criterion referenced evaluation. 
(5) Assess Learner Behavior on. Selected Obj ectives 

A pattern of matrix sanpling will be used to detennlne the 
present learner capabilities in the several domains. It is 
anticipated that efforts will focus initially on cognitive 
objectives in grades nine through 12. The actual learner 
perfomance on the selected obj ectives be compared with the 
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desired or prefewed level of perfonniajice specified with 
the objective, A negative discTepmcy^ bitten the two 
xeflects a learner need. From a tabulation of the severaL 
perfoimance areas critical aeads will be ascertaimed. 

(6) Plan to Meet Needs 

Identified critical needs prov^ide v^alid data for educatloa- 
al decision-naking in plajmliig to achieve defeiisible goals- 
objectives. If the steps in the cfcle have been carefully 
followed, professional edTjcators should hive an abmdance 
of valid data to use in this pTOcesSj and should likewise 
have persuasive Infotmatioii regardiiig fundj needed to iiiiple- 
meiit progiam modifications, and imcvationj, (e.gis Title 
III). 

(7) Programming to Meet Needs 

It is e^^ected that, provided with the inforaatloii derived 
from needs assessinenti attaijitstrators ajid their staffs will 
make prograjn modificatioiis that v/lll be geared to the ineat- 
ing of the critical needs as detennined, 
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III. AmiNISTRATIVE CONSIDERATIONS 

The Bureau of Indian Affairs of the Department o£ the Interior is 
made of a number of Divisions which provide a wide range of 
services to Native Americans. TTie largest of these is the Office 
of Education Programs, which is organized as shown in Figure 5. 

Each Area Office has aiMng its varied service divisions, an Assis- 
tant Area Director for Education, and a staff of education personnel 
to provide assistance and services to Agencies within the Area. In 
tum, the i\gencles administer individual schools. 

In preparing the educational needs assessment design, personnel from 
each level, including the school, have been involved in all activities 
to date. Over 50 were involved as participants in the July workshop. 
In addition, school board members and students will participate (and 
have participated) as team members . 

The Evaluation Division of the Central Office headquartered in 
Albuquerque will coordinate all aspects of the Bureau-wide needs 
assessment, and staff members of other Central Office Divisions will 
assist from time to time. In general, existing staff at the Area 
and Agency levels will fill the major staffing needs. 

Additionally, the data analysis and storage will be handled by the 
Education Programs staff of the Indian Affairs Data Center, located 
in Albuquerque. This is an especially critical aspect of the projec- 
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tion, since the varied and widely scattered populations to be assessed 
will generate a great deal of data. 

Finally, the work to be acconplished mil, for the most part, be 
performed within the regular fimding of the several adninistratlve 
entities of the Office of Education Programs. From time to time, as 
special situations and needs arise, the Evaluation Division will seek 
special funding for project components. 
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^SEAROl Pm EVALUATION REPORT SERIES 



The Education activity of the BIA has always produced a large and 
steady nxmbeT of very useful reports t In recent timB^ there seems 
to be an increasingly larger nimber of high quality reports. Too* 
throughout the years ^ there has not been an att^rqst to organize or 
arrange the reports in such a mnner that they become a ireful and 
systematic body of information. In order to provide a systematic 
arrangCTient of high quality reports so that they may be made avail- 
able to educators, a Research ^d Evaluation Report Series has 
been established by the Indian Education Resources Center (lERC) , 
Divis ion of Evaluation and Program Review, 

Tlie general objectives of the Series are to: 

(1) Provide a systOTiatlc arrangement of education reports. 

(2) Identify those reports considered to be high m quality* 

(3) Make pertinent data available to BIA educators and when 
possible, to educators outside the BIA. 

(4) Make it possible for professional educators involved in 
research pertinent to the schooling of Indian children 
to share their experiences with a greater audience, 

(5} Assist in the overall evaluation process of the BIA 
Education activity. 
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